Neural Mechanisms of Binaural Processing in the Auditory Brainstem.

Spatial hearing, and more specifically the ability to localize sounds in space, is one of the most studied and best understood aspects of hearing. Because there is no coding of acoustic space at the receptor organ, physiological sensitivity to spatial aspects of sounds first emerges in the central nervous system. Much progress has been made in the identification and characterization of the circuits in the auditory brainstem that create sensitivity to binaural and monaural cues toward acoustic space. We review the progress over the past third of a century, with a focus on the mammalian brainstem and on the anatomy and cellular physiology underlying the physiological tuning of monaural and binaural circuits to acoustic cues toward spatial hearing. In addition to examining the detailed mechanisms involved in the processing of the three main spatial cues, we also review the integration of these cues and their use toward behavior. © 2019 American Physiological Society. Compr Physiol 9:1503-1575, 2019.

Behavior and modeling of two-dimensional precedence effect in head-unrestrained cats.

The precedence effect (PE) is an auditory illusion that occurs when listeners localize nearly coincident and similar sounds from different spatial locations, such as a direct sound and its echo. It has mostly been studied in humans and animals with immobile heads in the horizontal plane; speaker pairs were often symmetrically located in the frontal hemifield. The present study examined the PE in head-unrestrained cats for a variety of paired-sound conditions along the horizontal, vertical, and diagonal axes. Cats were trained with operant conditioning to direct their gaze to the perceived sound location. Stereotypical PE-like behaviors were observed for speaker pairs placed in azimuth or diagonally in the frontal hemifield as the interstimulus delay was varied. For speaker pairs in the median sagittal plane, no clear PE-like behavior occurred. Interestingly, when speakers were placed diagonally in front of the cat, certain PE-like behavior emerged along the vertical dimension. However, PE-like behavior was not observed when both speakers were located in the left hemifield. A Hodgkin-Huxley model was used to simulate responses of neurons in the medial superior olive (MSO) to sound pairs in azimuth. The novel simulation incorporated a low-threshold potassium current and frequency mismatches to generate internal delays. The model exhibited distinct PE-like behavior, such as summing localization and localization dominance. The simulation indicated that certain encoding of the PE could have occurred before information reaches the inferior colliculus, and MSO neurons with binaural inputs having mismatched characteristic frequencies may play an important role.

Dynamic sound localization in cats.

Sound localization in cats and humans relies on head-centered acoustic cues. Studies have shown that humans are able to localize sounds during rapid head movements that are directed toward the target or other objects of interest. We studied whether cats are able to utilize similar dynamic acoustic cues to localize acoustic targets delivered during rapid eye-head gaze shifts. We trained cats with visual-auditory two-step tasks in which we presented a brief sound burst during saccadic eye-head gaze shifts toward a prior visual target. No consistent or significant differences in accuracy or precision were found between this dynamic task (2-step saccade) and the comparable static task (single saccade when the head is stable) in either horizontal or vertical direction. Cats appear to be able to process dynamic auditory cues and execute complex motor adjustments to accurately localize auditory targets during rapid eye-head gaze shifts.

Simultaneous comparison of two sound localization measures.

Almost all behavioral studies of sound localization have used either an approach-to-target or pointing/orienting task to assess absolute sound localization performance, yet there are very few direct comparisons of these measures. In an approach-to-target task, the subject is trained to walk to a sound source from a fixed location. In an orienting task, finger, head and/or eye movements are monitored while the subject's body is typically constrained. The fact that subjects may also initiate head and eye movements toward the target during the approach-to-target task allows us to measure the accuracy of the initial orienting response and compare it with subsequent target selection. To perform this comparison, we trained cats to localize a broadband noise presented randomly from one of four speakers located ± 30° and ± 60° in azimuth. The cat responded to each sound presentation by walking to and pressing a lever at the perceived location, and a food reward was delivered if the first attempt was correct. In tandem, we recorded initial head and eye orienting movements, via magnetic search coils, immediately following target onset and prior to the walking response. Reducing either stimulus duration or level resulted in a systematic decline in both measurements of localization performance. When the task was easy, localization performance was accurate for both measures. When the task was more difficult, the number of incorrect (i.e., wrong selection) and no-go (i.e., no selection) responses increased. Interestingly, for many of the incorrect trials, there was a dissociation between the orienting response and the target selected, and for many of the no-go trials, the gaze oriented towards the correct target even though the cat did not move to it. This suggests different neural systems governing walking to a target as compared to unconditioned gaze orienting.

Localization of click trains and speech by cats: the negative level effect.

Although localization of sound in elevation is believed to depend on spectral cues, it has been shown with human listeners that the temporal features of sound can also greatly affect localization performance. Of particular interest is a phenomenon known as the negative level effect, which describes the deterioration of localization ability in elevation with increasing sound level and is observed only with impulsive or short-duration sound. The present study uses the gaze positions of domestic cats as measures of perceived locations of sound targets varying in azimuth and elevation. The effects of sound level on localization in terms of accuracy, precision, and response latency were tested for sound with different temporal features, such as a click train, a single click, a continuous sound that had the same frequency spectrum of the click train, and speech segments. In agreement with previous human studies, negative level effects were only observed with click-like stimuli and only in elevation. In fact, localization of speech sounds in elevation benefited significantly when the sound level increased. Our findings indicate that the temporal continuity of a sound can affect the frequency analysis performed by the auditory system, and the variation in the frequency spectrum contained in speech sound does not interfere much with the spectral coding for its location in elevation.

Effects of forward masking on sound localization in cats: basic findings with broadband maskers.

Forward masking is traditionally measured with a detection task in which the addition of a preceding masking sound results in an increased signal-detection threshold. Little is known about the influence of forward masking on localization of free-field sound for human or animal subjects. Here we recorded gaze shifts of two head-unrestrained cats during localization using a search-coil technique. A broadband (BB) noise masker was presented straight ahead. A brief signal could come from 1 of the 17 speaker locations in the frontal hemifield. The signal was either a BB or a band-limited (BL) noise. For BB targets, the presence of the forward masker reduced localization accuracy at almost all target levels (20 to 80 dB SPL) along both horizontal and vertical dimensions. Temporal decay of masking was observed when a 15-ms interstimulus gap was added between the end of the masker and the beginning of the target. A large effect of forward masking was also observed for BL targets with low (0.2-2 kHz) and mid (2-7 kHz) frequencies, indicating that the interaural timing cue is susceptible to forward masking. Except at low sound levels, a small or little effect was observed for high-frequency (7-15 kHz) targets, indicating that the interaural level and the spectral cues in that frequency range remained relatively robust. Our findings suggest that different localization mechanisms can operate independently in a complex listening environment.

Gaze shifts to auditory and visual stimuli in cats.

While much is known about the metrics and kinematics of gaze shifts to visual targets in cats, little is known about gaze shifts to auditory targets. Here, cats were trained to localize auditory and visual targets via gaze shifts. Five properties of gaze shifts to sounds were observed. First, gaze shifts were accomplished primarily by large head movements. Unlike primates, the head movement in cats often preceded eye movement though the relative timing of eye in head and head latencies depended upon the target modality and gaze shift magnitude. Second, gaze shift latencies to auditory targets tended to be shorter than equivalent shifts to visual targets for some conditions. Third, the main sequences relating gaze amplitude to maximum gaze velocity for auditory and visual targets were comparable. However, head movements to auditory and visual targets were less consistent than gaze shifts and tended to undershoot the targets by 30 % for both modalities. Fourth, at the end of gaze movement, the proportion of the gaze shift accomplished by the eye-in-head movement was greater to visual than auditory targets. On the other hand, at the end of head movement, the proportion of the gaze shift accomplished by the head was greater to auditory than visual targets. Finally, gaze shifts to long-duration auditory targets were accurate and precise and were similar to accuracy of gaze shifts to long-duration visual targets. Because the metrics of gaze shifts to visual and auditory targets are nearly equivalent, as well as their accuracy, we conclude that both sensorimotor tasks use primarily the same neural substrates for the execution of movement.

Behavioral and modeling studies of sound localization in cats: effects of stimulus level and duration.

Sound localization accuracy in elevation can be affected by sound spectrum alteration. Correspondingly, any stimulus manipulation that causes a change in the peripheral representation of the spectrum may degrade localization ability in elevation. The present study examined the influence of sound duration and level on localization performance in cats with the head unrestrained. Two cats were trained using operant conditioning to indicate the apparent location of a sound via gaze shift, which was measured with a search-coil technique. Overall, neither sound level nor duration had a notable effect on localization accuracy in azimuth, except at near-threshold levels. In contrast, localization accuracy in elevation improved as sound duration increased, and sound level also had a large effect on localization in elevation. For short-duration noise, the performance peaked at intermediate levels and deteriorated at low and high levels; for long-duration noise, this "negative level effect" at high levels was not observed. Simulations based on an auditory nerve model were used to explain the above observations and to test several hypotheses. Our results indicated that neither the flatness of sound spectrum (before the sound reaches the inner ear) nor the peripheral adaptation influences spectral coding at the periphery for localization in elevation, whereas neural computation that relies on "multiple looks" of the spectral analysis is critical in explaining the effect of sound duration, but not level. The release of negative level effect observed for long-duration sound could not be explained at the periphery and, therefore, is likely a result of processing at higher centers.

The role of spectral composition of sounds on the localization of sound sources by cats.

Sound localization along the azimuthal dimension depends on interaural time and level disparities, whereas localization in elevation depends on broadband power spectra resulting from the filtering properties of the head and pinnae. We trained cats with their heads unrestrained, using operant conditioning to indicate the apparent locations of sounds via gaze shift. Targets consisted of broadband (BB), high-pass (HP), or low-pass (LP) noise, tones from 0.5 to 14 kHz, and 1/6 octave narrow-band (NB) noise with center frequencies ranging from 6 to 16 kHz. For each sound type, localization performance was summarized by the slope of the regression relating actual gaze shift to desired gaze shift. Overall localization accuracy for BB noise was comparable in azimuth and in elevation but was markedly better in azimuth than in elevation for sounds with limited spectra. Gaze shifts to targets in azimuth were most accurate to BB, less accurate for HP, LP, and NB sounds, and considerably less accurate for tones. In elevation, cats were most accurate in localizing BB, somewhat less accurate to HP, and less yet to LP noise (although still with slopes ∼0.60), but they localized NB noise much worse and were unable to localize tones. Deterioration of localization as bandwidth narrows is consistent with the hypothesis that spectral information is critical for sound localization in elevation. For NB noise or tones in elevation, unlike humans, most cats did not have unique responses at different frequencies, and some appeared to respond with a "default" location at all frequencies.

Axonal branching patterns as sources of delay in the mammalian auditory brainstem: a re-examination.

In models of temporal processing, time delays incurred by axonal propagation of action potentials play a prominent role. A pre-eminent model of temporal processing in audition is the binaural model of Jeffress (1948), which has dominated theories regarding our acute sensitivity to interaural time differences (ITDs). In Jeffress' model, a binaural cell is maximally active when the ITD is compensated by an internal delay, which brings the inputs from left and right ears in coincidence, and which would arise from axonal branching patterns of monaural input fibers. By arranging these patterns in systematic and opposite ways for the ipsilateral and contralateral inputs, a range of length differences, and thereby of internal delays, is created so that the ITD is transformed into a spatial activation pattern along the binaural nucleus. We reanalyze single, labeled, and physiologically characterized axons of spherical bushy cells of the cat anteroventral cochlear nucleus, which project to binaural coincidence detectors in the medial superior olive (MSO). The reconstructions largely confirm the observations of two previous reports, but several features are observed that are inconsistent with Jeffress' model. We found that ipsilateral projections can also form a caudally directed delay line pattern, which would counteract delays incurred by caudally directed contralateral projections. Comparisons of estimated axonal delays with binaural physiological data indicate that the suggestive anatomical patterns cannot account for the frequency-dependent distribution of best delays in the cat. Surprisingly, the tonotopic distribution of the afferent endings indicate that low characteristic frequencies are under-represented rather than over-represented in the MSO.

Short-latency, goal-directed movements of the pinnae to sounds that produce auditory spatial illusions.

The precedence effect (PE) is an auditory spatial illusion whereby two identical sounds presented from two separate locations with a delay between them are perceived as a fused single sound source whose position depends on the value of the delay. By training cats using operant conditioning to look at sound sources, we have previously shown that cats experience the PE similarly to humans. For delays less than +/-400 mus, cats exhibit summing localization, the perception of a "phantom" sound located between the sources. Consistent with localization dominance, for delays from 400 mus to approximately 10 ms, cats orient toward the leading source location only, with little influence of the lagging source. Finally, echo threshold was reached for delays >10 ms, where cats first began to orient to the lagging source. It has been hypothesized by some that the neural mechanisms that produce facets of the PE, such as localization dominance and echo threshold, must likely occur at cortical levels. To test this hypothesis, we measured both pinnae position, which were not under any behavioral constraint, and eye position in cats and found that the pinnae orientations to stimuli that produce each of the three phases of the PE illusion was similar to the gaze responses. Although both eye and pinnae movements behaved in a manner that reflected the PE, because the pinnae moved with strikingly short latencies ( approximately 30 ms), these data suggest a subcortical basis for the PE and that the cortex is not likely to be directly involved.

Influence of sound source location on the behavior and physiology of the precedence effect in cats.

Psychophysical experiments on the precedence effect (PE) in cats have shown that they localize pairs of auditory stimuli presented from different locations in space based on the spatial position of the stimuli and the interstimulus delay (ISD) between the stimuli in a manner similar to humans. Cats exhibit localization dominance for pairs of transient stimuli with |ISDs| from approximately 0.4 to 10 ms, summing localization for |ISDs| < 0.4 ms and breakdown of fusion for |ISDs| > 10 ms, which is the approximate echo threshold. The neural correlates to the PE have been described in both anesthetized and unanesthetized animals at many levels from auditory nerve to cortex. Single-unit recordings from the inferior colliculus (IC) and auditory cortex of cats demonstrate that neurons respond to both lead and lag sounds at ISDs above behavioral echo thresholds, but the response to the lag is reduced at shorter ISDs, consistent with localization dominance. Here the influence of the relative locations of the leading and lagging sources on the PE was measured behaviorally in a psychophysical task and physiologically in the IC of awake behaving cats. At all configurations of lead-lag stimulus locations, the cats behaviorally exhibited summing localization, localization dominance, and breakdown of fusion. Recordings from the IC of awake behaving cats show neural responses paralleling behavioral measurements. Both behavioral and physiological results suggest systematically shorter echo thresholds when stimuli are further apart in space.

The vestibulo-auricular reflex.

The mammalian orienting response to sounds consists of a gaze shift that can be a combination of head and eye movements. In animals with mobile pinnae, the ears also move. During head movements, vision is stabilized by compensatory rotations of the eyeball within the head because of the vestibulo-ocular reflex (VOR). While studying the gaze shifts made by cats to sounds, a previously uncharacterized compensatory movement was discovered. The pinnae exhibited short-latency, goal-directed movements that reached their target while the head was still moving. The pinnae maintained a fixed position in space by counter-rotating on the head with an equal but opposite velocity to the head movement. We call these compensatory ear movements the vestibulo-auricular reflex (VAR) because they shared many kinematic characteristics with the VOR. Control experiments ruled out efference copy of head position signals and acoustic tracking (audiokinetic) of the source as the cause of the response. The VAR may serve to stabilize the auditory world during head movements.

Can measures of sound localization acuity be related to the precision of absolute location estimates?

Studies of sound localization use relative or absolute psychoacoustic paradigms. Relative tasks assess acuity by determining the smallest angle separating two sources that subjects can discriminate, the minimum audible angle (MAA), whereas absolute tasks measure subjects' abilities to indicate sound location. It is unclear whether or how measures from the two tasks are related, though the belief that the MAA is specifically related to the precision of absolute localization is common. The present study aimed to investigate the basis of this relationship by comparing the precision of absolute location estimates with a measure of spatial acuity computed from the same data. Three cats were trained to indicate apparent sound source locations that varied in azimuth and elevation via orienting gaze shifts (combined eye and head movements). The precision of these absolute responses, as measured by their standard deviation, was compared with acuity thresholds derived from receiver operating characteristic (ROC) analyses of the cumulative distributions. Surprisingly, the acuity measures were occasionally very poor indicators of absolute localization precision. Incongruent results were attributed to errors in mean accuracy, which are disregarded in analyses of traditional relative tasks. Discussion focuses on the potential for internal biases to affect measures of localization acuity.

A matter of time: internal delays in binaural processing.

As an animal navigates its surroundings, the sounds reaching its two ears change in waveform similarity (interaural correlation) and in time of arrival (interaural time difference, ITD). Humans are exquisitely sensitive to these binaural cues, and it is generally agreed that this sensitivity involves coincidence detectors and internal delays that compensate for external acoustic delays (ITDs). Recent data show an unexpected relationship between the tuning of a neuron to frequency and to ITD, leading to several proposals for sources of internal delay and the neural coding of interaural temporal cues. We review the alternatives, and argue that an understanding of binaural mechanisms requires consideration of sensitivity not only to ITDs, but also to interaural correlation.

Interaural phase and level difference sensitivity in low-frequency neurons in the lateral superior olive.

The lateral superior olive (LSO) is believed to encode differences in sound level at the two ears, a cue for azimuthal sound location. Most high-frequency-sensitive LSO neurons are binaural, receiving inputs from both ears. An inhibitory input from the contralateral ear, via the medial nucleus of the trapezoid body (MNTB), and excitatory input from the ipsilateral ear enable level differences to be encoded. However, the classical descriptions of low-frequency-sensitive neurons report primarily monaural cells with no contralateral inhibition. Anatomical and physiological evidence, however, shows that low-frequency LSO neurons receive low-frequency inhibitory input from ipsilateral MNTB, which in turn receives excitatory input from the contralateral cochlear nucleus and low-frequency excitatory input from the ipsilateral cochlear nucleus. Therefore, these neurons would be expected to be binaural with contralateral inhibition. Here, we re-examined binaural interaction in low-frequency (less than approximately 3 kHz) LSO neurons and phase locking in the MNTB. Phase locking to low-frequency tones in MNTB and ipsilaterally driven LSO neurons with frequency sensitivities <1.2 kHz was enhanced relative to the auditory nerve. Moreover, most low-frequency LSO neurons exhibited contralateral inhibition: ipsilaterally driven responses were suppressed by raising the level of the contralateral stimulus; most neurons were sensitive to interaural time delays in pure tone and noise stimuli such that inhibition was nearly maximal when the stimuli were presented to the ears in-phase. The data demonstrate that low-frequency LSO neurons of cat are not monaural and can exhibit contralateral inhibition like their high-frequency counterparts.

Sound-localization performance in the cat: the effect of restraining the head.

In oculomotor research, there are two common methods by which the apparent location of visual and/or auditory targets are measured, saccadic eye movements with the head restrained and gaze shifts (combined saccades and head movements) with the head unrestrained. Because cats have a small oculomotor range (approximately +/-25 degrees), head movements are necessary when orienting to targets at the extremes of or outside this range. Here we tested the hypothesis that the accuracy of localizing auditory and visual targets using more ethologically natural head-unrestrained gaze shifts would be superior to head-restrained eye saccades. The effect of stimulus duration on localization accuracy was also investigated. Three cats were trained using operant conditioning with their heads initially restrained to indicate the location of auditory and visual targets via eye position. Long-duration visual targets were localized accurately with little error, but the locations of short-duration visual and both long- and short-duration auditory targets were markedly underestimated. With the head unrestrained, localization accuracy improved substantially for all stimuli and all durations. While the improvement for long-duration stimuli with the head unrestrained might be expected given that dynamic sensory cues were available during the gaze shifts and the lack of a memory component, surprisingly, the improvement was greatest for the auditory and visual stimuli with the shortest durations, where the stimuli were extinguished prior to the onset of the eye or head movement. The underestimation of auditory targets with the head restrained is explained in terms of the unnatural sensorimotor conditions that likely result during head restraint.

Cats exhibit the Franssen Effect illusion.

The Franssen Effect (FE) is a striking auditory illusion previously demonstrated only in humans. To elicit the FE, subjects are presented with two spatially-separated sounds; one a transient tone with an abrupt onset and immediate ramped offset and the other a sustained tone of the same frequency with a ramped onset which remains on for several hundred ms. The FE illusion occurs when listeners localize the tones at the location of the transient signal, even though that sound has ended and the sustained one is still present. The FE illusion occurs most readily in reverberant environments and with pure tones of approximately 1-2.5 kHz in humans, conditions where sound localization is difficult in humans. Here, we demonstrate this illusion in domestic cats using, for the first time, localization procedures. Previous studies in humans employed discrimination procedures, making it difficult to link the FE to sound localization mechanisms. The frequencies for eliciting the FE in cats were higher than in humans, corresponding to frequencies where cats have difficulty localizing pure tones. These findings strengthen the hypothesis that difficulty in accurately localizing sounds is the basis for the FE.

Cross correlation by neurons of the medial superior olive: a reexamination.

Initial analysis of interaural temporal disparities (ITDs), a cue for sound localization, occurs in the superior olivary complex. The medial superior olive (MSO) receives excitatory input from the left and right cochlear nuclei. Its neurons are believed to be coincidence detectors, discharging when input arrives simultaneously from the two sides. Many current psychophysical models assume a strict version of coincidence, in which neurons of the MSO cross correlate their left and right inputs. However, there have been few tests of this assumption. Here we examine data derived from two earlier studies of the MSO and compare the responses to the output of a computational model. We find that the MSO is not an ideal cross correlator. Ideal cross correlation implies a strict relationship between the precision of phase-locking of the inputs and the range of ITDs to which a neuron responds. This relationship does not appear to be met. Instead, the modeling implies that a neuron responds over a wider range of ITDs than expected from the inferred precision of phase-locking of the inputs. The responses are more consistent with a scheme in which the neuron can also be activated by the input from one side alone. Such activation degrades the tuning of neurons in the MSO to ITDs.

Neural correlates of the precedence effect in the inferior colliculus of behaving cats.

Several auditory spatial illusions, collectively called the precedence effect (PE), occur when transient sounds are presented from two different spatial locations but separated in time by an interstimulus delay (ISD). For ISDs in the range of localization dominance (<10 ms), a single fused sound is typically located near the leading source location only, as if the location of the lagging source were suppressed. For longer ISDs, both the leading and lagging sources can be heard and localized, and the shortest ISD where this occurs is called the echo threshold. Previous physiological studies of the extracellular responses of single neurons in the inferior colliculus (IC) of anesthetized cats and unanesthetized rabbits with sounds known to elicit the PE have shown correlates of these phenomena though there were differences in the physiologically measured echo thresholds. Here we recorded in the IC of awake, behaving cats using stimuli that we have shown to evoke behavioral responses that are consistent with the precedence effect. For small ISDs, responses to the lag were reduced or eliminated consistent with psychophysical data showing that sound localization is based on the leading source. At longer ISDs, the responses to the lagging source recovered at ISDs comparable to psychophysically measured echo thresholds. Thus it appears that anesthesia, and not species differences, accounts for the discrepancies in the earlier studies.